Mandate Proof of Concept for all vulnerability findings#66
Merged
Conversation
Every finding must now include a reproducible Proof of Concept with: - Numbered reproduction steps - Exact payload/command (copy-pasteable) - Raw evidence output proving exploitation - Impact demonstration (shown, not described) - Screenshot evidence where applicable Changes: - claude_playbook.md: Add PoC Requirements section with per-vuln-class minimums and validation checklist - VulnerabilityEntry: Add poc_steps (list[str]) and poc_payload (str) fields with descriptive metadata - All 8 prompt templates: Add PoC mandate to report sections and guidelines (findings without PoC downgraded to info) - Agent prompts: Ingestion extracts PoC from tool output, Processing preserves PoC during dedup, Synthesis validates PoC completeness https://claude.ai/code/session_01UC8hHFgeUeMFboP3grei4t
The single quote in the SQL injection example ('OR 1=1--) was breaking
the surrounding single-quoted string literal. Switch to double-quoted
string with escaped inner double quotes for that line.
https://claude.ai/code/session_01UC8hHFgeUeMFboP3grei4t
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This change enforces a mandatory Proof of Concept (PoC) requirement for all vulnerability findings across all assessment templates and the data model. Every vulnerability must now include reproducible steps, exact payloads/commands, raw evidence output, and demonstrated impact before it can be considered a valid finding.
Key Changes
Data Model Updates
VulnerabilityEntryclass (aggregated_payload.py):poc_steps: Ordered list of reproduction steps for independent verificationpoc_payload: Exact, copy-pasteable payload, command, or HTTP requestevidence: Enhanced field description emphasizing concrete, non-theoretical proofPlaybook & Template Updates
claude_playbook.md:AggregatedPayloadevidence,poc_steps, andpoc_payloadpopulationAll assessment templates (
full-pentest.md,full-attack-chain.md,bug-bounty.md,api-security.md,vuln-assessment.md,web-app-assessment.md,network-infrastructure.md,quick-scan.md):poc_steps,poc_payload, andevidencefieldsAgent Updates
processingagent.md:synthesisagent.md:ingestionagent.md:poc_stepsandpoc_payloadfrom tool outputNotable Implementation Details
https://claude.ai/code/session_01UC8hHFgeUeMFboP3grei4t